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ABSTRACT 

This final report summarizes the major Local/State 
Bilingual Program evaliiation findings for the Austin Independent 
School District around four topics: (1) academic achievement; (2) the 
new kindergarten and first-grade Limited English Proficiency (LEP) 
exit criteria; (3) bilingual teacher recruitment; and (4) what can be 

\rned from this year's evaluation. The overall pattern of Hispanic 
i^. pupil achievement was up from last year's levels in reading, 
language and mathematics computation, but still dramatically below 
their English-monolingual peers. Vietnamese LEP students' performance 
was progressing toward or exceeding the national norm. Lowest LEP 
student achievement gains were in reading. Except for students at 
Allison and Becker in the Schoolwide Project (low pupil-to-teacher 
ratios), Chapter 1 programs showed no achievement benefits for LEP 
students. The District's new exit criteria for kindergarteners and 
first graders helped stabilize the previous "entry-exit-reentry" 
problem. Bilingually-endorsed teacher recruitment has been quite 
successful, but many more teachers will have to be recruited if the 
state does not agree to letting English as a Second Language-endorsed 
teachers serve English-dominant and balanced-bilingual LEP students. 
(BS) 
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SUMMARY REPORT 



Project Title: Local/State Bilingual 

Contact Person: Jonathan J. Curtis 
Major Positive Finding ^: 



1. In comparison to last year, LEP performance is up in 
reading, language, and mathematics computation. Howev- 
er, there is still a dramatic gap between the academic 
performance of LEP students and their English-monolin- 
gual peers . 

2. Vietnamese LEP student performance in math computation, 
language, and reading is either progressing toward or 
exceeding the national norm, 

3. LEP students in Allison and Becker's Schoolwide Pro- 
jects (low pupil-to-teacher schools) are outperforming 
their other Chapter 1 and non-Chapter 1 LEP peers at 
certain grade levels and content areas* At no grade 
level and in no content area do their counterparts dem- 
onstrate performance superior to theirs. 

4. The District's new exit criteria for kindergarten and 
first graders have helped to stabalize the "entry-exit- 
reentry*' problem associated with the previous criteria. 

Major Findings Requiring Action: 

1. LEP students typically make their lowest gains (about 8 
to 9 months /year) in reading . This results in an 
ever-increasing gap between these students and the na- 
tional average. 

2. The District's efforts to recruit bilingually endorsed 
teachers has been quite successful. However, we will 
need to recruit far more if the state does not recognize 
the legitimacy of the District's contention that Eng- 
lish-dominant and balanced-bilingual LEP pupils can be 
served by ESL-endorsed rather than bilingually endorsed 
teachers • 

3. Except for the students at Allison and Becker, there is 
no detectable achievement benefit to LEP students from 
being served by the Chr )tej 1 Program, 
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Evaluation Summary: 

This section summarizes the major Local/State Bilingual Program find- 
ings and is organized around the following topics. 

• Academic Achievement 

• New Kindergarten and First-Grade LEP Exit Criteria 

• Bilingual Teacher Recruitment 

• What Can We Learn From This Year's Evaluation? 



Academic Achievement 

Academic achievement is the primary focus of educational programs. 
They are effective or not based primarily on the academic performance 
of participating students. 

Hispanic Achievement 

The overall pattern of Hispanic LEP pupil achievement is up from the 
levels attained last year. This means that the LEP population in AISD 
is not as far behind local and national averages compared to past 
years* LEP populations. However, there is still a dramatic gap be- 
tween the academic performance of LEP students and their English- 
monolingual peers. Performance of the Spanish-dominant LEP students 
in reading, language, and math computation illustrates this point 
(see Figures 1» 2, and 3). The 1984 Spanish-dominant LEP students 
outperformed their 1983 counterparts in every grade level and content 
area examined except at the eighth-grade level in language and math. 
Of 24 comparisons made, 22 favor the 1984 students. Exceptions to the 
overall pattern lie primarily with the English -dominant and 
balanced-bilingual students particularly in the area of language. 
Attachment 1 identifies where these exceptions occur. 

Figures 1-3 also illustrate the basic pattern of achievement across 
the grades. The pattern is of an ever-widening gai> between the na- 
tional norm and LEP students that is especially prominent in reading 
and language from grade 3 on. It appears as though little ground is 
lost until that grade. In math computation^ the ever-widening gap can 
also be noted, but it is much less pronounced. Math computation is 
the area of the standardized tests requiring the least English Lan- 
guage skills. Thus, LEP student performance in math computation 
provides a "picture" of how these students might perform if they were 
English proficient. In math computation these students are quite 
close to the national average. 
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Figure 1: 1983 AND I98ii ITBS READING GRADE EQUIVALENTS FOR SPANISH-DOMINANT LEP STUDENTS. 
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Figure 3: 1983 AND 198A ITBS MATH GRADE EQUIVALENTS FOR SPANISH-DOMINANT LEP STUDENTS. 



Vietnamese Achievemen t 

In math computation, language, and reading, Vietnamese LEP student 
performance is either progressing toward or exceeding the national 
norm. The only exceptions to this trend, over the grades examined 
(2-8), is in the area of reading for second and eighth grades and in 
language at the seventh grade. Of the 24 comparisons made, all but 3 
show gains from 1983 to 1984 of over a year. In 11 of the 24 compar- 
isons, Vietnamese performance is already above grade level and still 
rising at a rate of more than a year's growth per year. Under these 
circumstances, much of the Vietnamese LEP population will become Eng- 
lish proficient rather rapidly. 

Chapter 1 Achievement 

Chapter 1 students are provided special instructional services that 
are designed to enhance their language and reading achievement. Al- 
though there is no equivalent group with which to compare, non-Chapter 
1 LEP students is the best available. These students from higher so- 
cio-economic status families have home background characteristics 
that may be more likely to encourage academic learning than is true 
for Chapter 1 pupils* Thus, finding achievement differences favoring 
Chapter 1 students would suggest a strong Chapter 1 effect. 
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Comparison of Chapter 1 LEP with non-Chapter 1 LEP was done using co- 
varlate analysis so that adjustments associated with differences in 
pretest scores could be made. Allison and Becker students were re- 
moved from the comparisons because they represent a very special popu- 
lation whose achievement performance is examined separately. None of 
the comparisons conducted favored the Chapter 1 LEP students. The 
non-Chapter 1 LEP students' achievement was superior to the LEP Chap- 
ter 1 students in language at the second-grade level, in math at the 
third-grade level, and in reading and math at the fourth-grade level. 
No other significant differences were detected between the groups. 

Low Pupils -to-Teacher Ratio SchooL s Performance 

Comparison of LEP students in Schoolwide Project Schools, Allison and 
Becker (schools with low pupil-to-teacher ratios) with other Chapter 
1 LEP students, indicates that the Allison and Becker pupils are doing 
better than their Chapter 1 counterparts in language achievement at 
the second-, third-, and sixth-grade levels and in math at the secondh- 
and third-grade levels- At no grade level and in no achievement area 
are the Chj.pter 1 students outperforming the Allison and Becker stu- 
dents. Analysis of covariance was used to adjust for possible 
achievement differences on the pretest (1983 ITBS)- Kindergarten and 
first-grade students were not included because appropriate pretest 
data are not available from the ITBS, 

Non-Chapter 1 students tend to come from homes where the parents are 
better educated and may provide more learning assistance to their 
children. Thus, if pupils at Allison and Becker outperform their 
non-Chapter 1 LEP peers at any level, it provides strong evidence for 
the effectiveness of the Schoolwide Project Schools. Comparisons 
were made and the Allison and Becker LEP students demonstrated superi- 
or performance in reading at third and sixth grades and in math at 
second and third grades. At no grade level and in no achievement area 
were the Allison and Backer students surpassed in their achievement by 
the non-Chapter 1 LEP pupils. 

Why are Atlison and Becker more effective in teaching LEP students? 

Better teachers can be hypothesized and that may be the reason- How- 
ever, a stronger alternate hypothesis is that LEP students do better 
there because they get more individual attention. That is, class 
sizes at those schools are much smaller than anywhere else in the Dis- 
trict. They are supposed to serve no more than 15 students. This 
ratio is substantially lower than the District's average of 23 to 24 
students per teacher. 
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New Kindergarten and First-Grade LEP Exit Criteria 

When the 1981 bilingual law and its associated regulations were en- 
acted they contained criteria that were to be used to determine when a 
child was to exit LEP status and move into regular instruction. Com- 
mon criteria were established for students in grades 2-12. Kindergar- 
ten and first-grade criteria were not only different from the common 
criteria of grades 2-12, but the criteria were much simpler to attain. 
This situation, coupled with another regulation requiring districts 
to review the status of exited students for two years following their 
exit, created a situation where LEP students are likely to exit in 
kindergarten or first grade only to reenter at the second grade when 
more stringent criteria are applied. Such a situation often leads to 
inappropriate placement of the child for instructional purposes and 
to confusion and frustration of parents and District staff. 



To alleviate this situation, the criteria used for grades 2-12 were 
applied to first graders in AISD. No attempt to convey the grades 
2-12 criteria has been made here because of their complexity. They 
may be found in the Local/State Bilingual Program Technical Report, 
publication 83.31, Attachment VI-4. For kindergartners , , the criteria 
for exiting were changed from an easily attained score (79) on the 
Primary Acquisition of Language (PAL) test to the more rigorus requir- 
ment of a language score at the 5a%ile or greater on 'the districtwide 
administered Iowa Tests of Basic Skills (ITBS). Figures 4 and 5 il- 
lustrate the effect of the change in criteria. The number of exits at 
kindergarten and first grade is much lower after implementation of the 
new criteria than it was earlier. Futhermore, the number of pupils 
reentering LEP status at first and second grades in 1984 is about 1/4 
the number of reentries in 1983. From these data, it appears that the 
new criteria are functioning as they were designed to--there are fewer 
LEP student exits who later reenter. 
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^New criteria inpleaented. 



Figure A: NO. OF K & 1 LEP PUPILS 

EXITED FROM LEP STATUS SINCE 
THE 1981 BILINGUAL LAW. 
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Figure 5i NO. OF 1ST AND 2ND GRADE PUPILS 
WHO REENTERED LEP STATUS* 
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Bilingual Teacher Recruitment 

Bilingual education is required by state law when 20 or more elementa- 
ry LEP children of a given language are enrolled in the District at 
any specific elementary grade level. Thus, availability of bilingu- 
ally endorsed teachers is critical to compliance with State law. Un- 
der this year's distribution of LEP students, a bilingual program is 
required only for Hispanics (see Figure 6). By choice, a bilingual 
program is also maintained in AISD for the Vietnamese who represent 
the second largest LEP population of the District. 





IC 


1 


2 


3 


4 


5 


6 


7 


8 




10 


11 


12 


TOTAL 


Spanlah 




356 


288 


261 


252 


202 


156 


102 


86 


64 


31 


19 


12 


2,073 


VltttnaMM 


17 


IS 


14 


12 


13 


10 


13 


16 


9 


17 




6 


2 


150 




2 


3 


1 


4 


3 


6 


4 ' 


3 


2 






2 


0 


34 


L«otlKn 


2 


3 


2 


0 


2 


2 


7 


0 


4 






0 


0 


29 


Chlnaaa 


4 


4 


0 


1 


4 


3 


0 


2 


5 






0 


0 


27 


All OChera 


__19 


16 


11 


9 


9 




11 


5 


4 






6 


_6 


116 


Tocal 


286 


397 


316 


287 


283 


234 


191 


128 


112 


92 


50 


33 


20 


2,429 



Figure 6: SPRING 1984 LEP STUDENT COUNT BY GRADE AND LANGUAGE. 



The Texas Education Agency contends that all Hispanic LEP students, 
even those who are English dominant, must be served by bilingually en- 
dorsed teachers. Under the 1983-84 distribution of the 1,757 elemen- 
tary Hispanic LEP students, 315 bilingually endorsed teachers would 
be required to serve all of these students on a full-time basis. The 
projection is based upon the assumption that no more than 10 LEP stu- 
dents (District policy) would be served by a teacher and that even a 
single LEP child at a given grade and school would also be served by a 
bilingually endorsed teacher. 

The District contends that English -dominant and balanced-bilingual 
LEP students can be appropriately served by teachers with English as a 
Second Language (ESL) rather than bilingual endorsements. If the Eng- 
lish-dominant and balanced-bilingual Hispanic LEP pupils do not have 
to be served by bilingually endorsed teachers, 186 bilingually en- 
dorsed teachers at the appropriate schools and grade levels could 
serve all the Spanish-dominant LEP students in the District under the 
present distribution of these students. 
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Can the District mftet the needs of its Spanish-dominant LEP students 
for bilingually endorsed teachers? If the State recognizes the legit- 
imacy of the District's contention that English-dominant and 
balanced-bilingual LEP students can be served by ESL-endorsed rather 
than bilingually endorsed teachers, the District should be able to 
provide bilingual education to all its Spanish-dominant LEP pupils 
with the bilingually endorsed teachers that are presently employed. 
However, if the District's contention is rejected, additional bilin- 
gually endorsed teachers will be needed, the capacity of the Bilingual 
Center schools will have to be expanded and teaming, where a bilingual 
teacher serves LEP children other than her own for a portion of the 
day, will have to take place to a greater extent than in the past. 

The District has made and continues to make a major effort to recruit 
bilingual teachers so that its LEP students might be better served 
(see Figure 7) . 
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Figure 7; NUMBER OF REOUtAR BILINGUALLY ENDORSED 
TEACHERS EMPLOYED BY TjJE DISTRICT. 



What Can We Learn From This Year's Evaluation? 



• The overall pattern of Hispanic limited English 
proficient (LEP) student performance is up from 
the levels attained at the same grade levels last 
year in all content areas examined; reading, lan- 
guage , and math computation . Minor deviations 
from this pattern are associated primarily with 
balanced-bilingual and English-dominant LEP stu- 
dents in the area of language. 



Academic progress for Vietnamese LEP pupils is 
strong. They are 7 to 14 months above grade level 
in math. Their performance in language is also 
above grade level except at the sixth-, seventh-, 
and eighth-grade levels. In reading, the gap be- 
tween the national norm and Vietnamese performance 
is closing at every grade level except second and 
eighth. 
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Austin *s experiment wit;h low pupil-to-teacher ra- 
tio schools (Allison and Becker) appears to bene- 
fit LEP student achieVement, at least at the 
second-, third-, and sixth-grade levels. Further- 
more, they were not outperformed by LEP students 
at other schools at any grade level considered 
(2-6). 



♦ The District's new criteria for exiting LEP stu- 
dents at the kindergarten and first-grade levels 
have helped stabilize the ^'enter-exit- reenter" 
syndrome particularly associated with kindergar- 
ten and first-grade students. 



The District's efforts to recruit elementary bi- 
lingual teachers are showing success. The number 
of bilingual teachers employed has risen 22% from 
last year to this, representing a gain of 45 
teachers. As a result, the logistics required to 
serve Hispanic LEP students appropriately as re- 
quired by law should be much simpler. 



The Texas Education Agency contends that Hispanic 
English-dominant LEP students must be served by a 
bilingually endorsed teacher. The District con- 
tends that English is the dominant language of 
these students, and therefore, a bilingually en- 
dorsed teacher is unnecessary. If the State does 
not recognize the legitimacy of Austin's con- 
tention, the District will be faced with the need 
for a substantial increase in the number of bilin- 
gually endorsed teachers employed. 



There is no detectable achievement benefit to LEP 
students served by the Chapter 1 Program exept for 
the students at Allison and Becker. For the most 
part, they are progressing at a rate comparable to 
their non-Chapter 1 LEP pupil counterparts. How- 
ever, the non-Chapter 1 LEP student achievement 
was superior to Chapter 1 LEP pupils in language 
at the second-grade level, in math at the 
third-grade level, and in reading and math at the 
fourth-grade level. 



For the interested reader, a more detailed report of the evaluation 
procedures and associated findings may be found in the technical re- 
port entitled SYSTEMVIDE EVALUATION: 1983-84 Technical Report, Spe- 
cial Populations > Volume 2, Appendix I, Publication No. 83.31, 
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Evaluation Plan: Local/State Bilingual. Office of Research and 
Evaluation (Publication No. 83.09), Austin Independent School 
District, Austin, Texas, September 1983. 

SYSTEMWIDE EVALUATION: 1983-84 Technical Report • Office of 
Research and Evaluation (Publication No. 83.31, Appendix 1,), 
Austin Independent School District, Austin, Texas, June 1984. 

Simulated TEA Monitoring Vis ts. Office of Research and Evaluation 
(Publication No. 83. 61), Austin Independent School District, Austin, 
Texas ♦ June 1984. 
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ITBS MEAN GRADE EQUIVALENTS FOR SPANISH-DOMINANT, BALANCED-BILINGUAL, AND ENGLISH-DOMINANT LEP PUPILS 
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* 47* 
(.11) 



4.94 

* 31* 

(.25) 

5.61 

* 45* 
(.14) 

4.78 

* 34* 
(.22) 



5.29 

* 36* 
(.14) 

5.17 

* 83* 

(-11) 

4.90 

* 38* 

(-12) 



5.79 

* 26* 

(.37) 

6.06 

* 42* 
(.15) 

5.60 

* 25* 
(.17) 



6.17 

* 29* 

(.15) 

6.49 

* 57* 
(.13) 

5.84 

* 34* 

(-16) 



6.34 

* 28* 
(.48) 

7.23 

* 25* 

(.20) 

6.75 

* 31* 
(.27) 



6.86 

* 30* 
(.21) 

6.67 

* 26* 

(.23) 

7.06 

* 16* 
(.25) 



7.45 

* 35* 

(.46) 

7.59 

* 23* 
(.27) 

7.50 

* 18* 
(.33) 



7.26 

* 31* 
(.21) 

7.61 

* 21* 

(.30) 

7.77 

* 12* 
(.37) 



X: Average score. , ^ j j 

*N*: Number of pupil's scores used to calculate the average and standard error. 

(SE) : Standard error. 
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